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SUMMAHY 


Tlie  determination  of  ’’optimum"  solutions  to 
systems  of  linear  inequalities  has  assumed 
inoresalng  Importance  as  a  tool  for  mathe¬ 
matical  analysis  of  certain  problems  in 
economics,  logistics,  and  the  theory  of 
garaoa.  'liila  paper  develops  a  theory  for 
avoiding  assumptions  regarding  rank  of 
underlying  matrices  which  has  import  in 
applications  where  little  or  nothing  is 
known  about  the  rank  of  somo  linear  ine¬ 
quality  system  requiring  solution. 
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ME  OMnWj1^ ^SIMPLEX  METHOD  FOR  MINIMIZE  A  LINEAR 
- - - - INEAR  INEQUALITY  restraints 

by 

Qeorge  B0.nt2l3,  Alex  Orden, 

Philip  Wolfe*  ' 

Background  and 

*•  »••••* .. ....... 

MU..1  an.ly,u  of  oe  t  ,  lni  lmP°rt,n0*  «  «  tool  ror  math.- 

thaory  of  ga«*a  fr]  rvn  *  "  problem#  ln  economlca,  logistic.,  and  the 
„  L  J*l5J.  The  iolutlon  of  large  iv.^«  «.  u 

feasible  with  the  advent  or  highspeed  di  ^  P  °”ln* 

••  -  ...  .......  ,"’7“  ‘ 

difficulties  which  remain  to  be  rs.olved  “trlC«*«  «>•*•  -e 

paper  develop.  .  th.orv  r  «hnect.d  with  rank.  This 

Pa  a  theory  for  avoiding  ..sumption,  regard,™  , 

underlying  matrloe.  which  h.s  import  ln  °f 

nothing  i.  known  abet  the  rank  of  the  li„..r  i  ‘  #  °r 

oonslderstlon.  "equality  system  under 

rhe  simplex  procedure  la  a  fini*. 

-1-  *th  problem.  involvlng  UnM  1 

analogous  to  the  aolution  of  n  e  ne<*ualltiea  ln  a  manner  cloaely 

Oauaaian  elimination  nke  rh  eq'4ntl°n8  °r  m*trlx  ^veralon  by 

n*  Llke  ‘•he  latter  it  l.  < 

nent.1  theorem,  on  Une.r  ai^bralc  .y.t  Pr°Vlng 

°f  the  fundamental  duality  theo  ^  'Xample'  one  form 

airect  consequence  of  4-v, 

problem,  other  for™.  *  1  lng  the  main 

utner  form,  can  be  obtain.!  hy  trlvU,  ,  , 

a  fuller  dl.cu.aion  of  these  .  .  Manipulations  (for 

- - -  nterrelations  aee  [l  j]  );  ln  particular, 

A 1  ox  Orden  i  n  *>  r ■»  «  , 
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th«  duality  thaoram  [81,  [iol  Till  hcT  , 

"  J  L  L11->  ’  L1?]  lMdi  directly  to  th» 

Mlnmax  th.or.rn  for  z.ro-eum  t.o-*.r.on  [ld]  t0  .  00mpu_ 

«  lonal  mtthod  (polnt.d  out  Info  many  by  Homan  Rubin  and 
d.monatrat.d  by  Rob.rt  Dorfman,  R.f.  [1.3 )  „hloh  ilmulUn.ou,ly 

yl.Id.  optimal  atrjt.,1..  for  both  pl.y.ra  and  th.  v.iu.  0f  th. 
game . 

*“  term  ".lmpl.x"  avolv.d  from  .any  g.0o.trl0>1 
ve.alon  In  which  (ilk.  in  gam.  theory)  th.  varl.bl..  wore  non- 
n.gatlv.  and  .u».d  to  unity.  In  that  formulation  a  ol...  0f 
aolutlon."  wa.  oon.ld.r«d  whloh  lay  m  a  .lmpl.x, 

a.  gen. rails. d  method  giv.n  her.  wa.  outlln.d  ..rll.r 
by  th.  flmt  of  th.  author.  (Oantzlg)  In  a  .hort  footnot.,  R.f, 

J  *"d  th#n  <11"0U",*d  ■»*.  fully  at  th.  Sympo. lum  of 

Linear  In.qu.llti..  In  1951.  It.  purpo..,  a.  „  h.v.  air..dy 

Indicated,  1.  to  remov.  th.  re.trlctlv.  ...umptlon.  negating  th. 

of  th.  matrix  of  co.fficl.nt.  and  con.tant  .l.m.„t.  without 
which  a  condition  called  "Ccgen.raoy"  can  occur. 

Und.r  degeneracy  It  1.  poa.ibl.  for  th.  ,.iu.  of  th. 
.olutlon  to  remain  unchanged  from  on.  iteration  to  th.  n.xt  u.ing 
•  original  .lmpl.x  ».thod.  Hu.  cau.ee  the  proof  that  no  ba.l. 
can  be  repeated,  to  break  down.  I„  fact,  for  certain  .xampi..  - 
Al«  Hoffman  [U]  and  ore  of  th.  author.  (Wolf.)  nav.  .horn,  / 
that  It  wa.  po.elbl.  to  repeat  th.  ba.l,  and  thu.  cycle  forever" ‘ 
«Hh  th.  valu.  of  th.  aolutlon  remaining  unchanged  and  greater 
than  th.  deemed  minimum.  On  th.  other  hand,  It  le  lnt.re.tlng 
to  note  that  while  mo.t  problem,  that  an,,  from  practical  .ounce. 


V 


the  generalized  simplex  method 

trivial  ^  lj  WeU  kn0Wn'  8  8yatem  °f  llnear  lnft<*ualitiea  by 
.  V“  U“0n  °f  the  c.n  b 

;;:T by  an  — *  ™  ln  j 

-&L_ve  variables;  hence,  with  no  lo.a  of  generality  we  shall 

:rer  ba3i° probiem  in  thc  uuer  thia 

:.:::rrociate  with  a — ~ — 

-  vectors  snd  the ^  ~ 

1  variables  are  replaced  by  real 

variable  row  vect-o™  T  ^  y  1  •'^“COBVonent 

ectora .  in  the  orlalnni  , , 

j-giriai  system  the  real  varlahi#»« 

are  non-negative;  In  the  generally  . . . 

Ve0t°r  V<,rlab1'  *  >  °  <ln  thc  le3c^cogr.phl  n  sens.)  that  It  has 
non— zero  component-.*  .  -  1C  ha* 

...  -  - io  P^oxtive  and  bv  x  >  7 

that  x-y  u  y 

!t  la  eeay  to  see  that  th.  e,_..  ...r , 

the  vector  variables  of  th.  . exponents  of 

ea  of  the  generalized  system  satisfy  a  llnean 

system  In  non-negative  variables  In  which  th.  . 
the  la^  n r\  constant  terms  are 

h'  1  CO"’POnent‘>  °f  the  constant  vectors. 

X^Ot  P  m  rp  p  •  •  •  *-1 

0  1#  *  nJ  be  a  given  matrix  whose 

column,  p ,,  ig  a  vector  of  /_,i \ 

J  (m+1)  components.  Let  M  be  a 

matrix  of  ^  con.litl  ,  *  ^ 

e  01  m+1  .  -component  row  vietft».o 

The  generalized  matrix  prol  lem  ,  actors. 

P  °  iCni  io  concerned  with  fMnHits,.  — > 

•atisfylng  Ending  n  matrix  I 


(1) 


^  n 

Px  -  i;  p  7 
0  v  J 


M 


I 


■js-cr. 
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Wh*r*  (the  jth  ro,‘  of  X)  1«  a  row  vector  ot  J, 

ln*  tHe  th.  lexicographic  een.e  ‘ 


Xj  ^0 


(J  -  1,  2,  • • n) 


x0  -  Max  . 


Any  set  X  of  "variables”  (5c  •  7  v 
<l>  (2)  in  the  above  lexicn  .  °'  ^  8'  ^  Mtl8f*"« 

•  "feasible  .olutlon"  (or  m  “"”e  "1“  ^  « 

derived  Pr»  pn.ctlli  llV ^  “  8  ~  •  — 

«nt.  a  situation  which  h"  ^  "hlC>’  “U°h  “  “°lutlon  hep  re- 

optimal,  ih.  flr,t  variable  x  wh,  w  *  UC  "0t  neo— -Mly 

Of  the  solution  i.  t0  b  ^  ‘ha  "value" 

n*  is  to  be  maximized;  it  i„ 

others  to  be  non-negative,  m  certain  ao  COn8trai™d  like  the 

II)  It  may  henp.r  ...  ^  .  tBln  *PPll0**1°'“  <«  In  Section 

rP  ■  SOnie  of  the  other  varied  —  , 

restricted  to  be  non  iables  also  are  not 

to  be  non-negative,  nn.  1aaHo  . 

In  the  method  (see  the  di  °  *  3:1 1*ht  variation 

‘  th<!  ^locuaal°n  following  Theorem  V) 

A-ong  the  class  of  feasible  solutions  th.  , 

13  Pohfloulsrly  concerned  with  those  ,  '  P  "ethod 

the  properties  which  b#0l°" 

-olutlon  exl.ta  .  basic  aolutlon  ai.0  .„.t  1  ^n#V<,r 

whenever  a  maximicing  .elution  x .1 ^  ™ 

la  s  basic  solution  „  „  u  18  Unlqu®  it: 

ution,  and  whenever  a 

unique  there  ia  a  hum  06  Bolutlon  i«  not 

w  were  i.  a  basic  solution  that  ha.  the 

(Ifc-orem  VI).  A  basic  .olutlon  1,  one  m  which  1"8XlB1“n8  ValU*’ 

(including  x0)  are  considered  in  (i)  th.  Ml  ' 

),  the  remainder  being  set  equal 
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t°  zero;  l.e.,  it  la  of  the  form 


BV  -  P  v  +  z  p  y 
1-1  Ji  1 


-  M  , 


<vi  >  0.  Jj.  ¥  o) 


CP0'  PJi’  PJm^  10  Bn  <m+1)  £3M°r°  matrix  and  v  n  g 

rr,lX  °f  “  +  1  r0M  whose  1th  row  la  denoted  hy 

V  (1  ■  0,  1,  ...,  m).  y 

It  1.  clear  from  (4)  that  ainoe  M  i.  „f  rank  (m+l)  „o  ere 
and  v.  From  this  u  reedUy  folio*.  that  the  („+i)  column,  of  B 
constitute  a  heals  l„  the  apec.  of  vector,  PJ(  and  the  solution  V  l. 

uniquely  determined.  Moreover  since  the 

oreovcr,  since  the  rank  of  V  1,  (mtl)>  none 

Of  the  (m+1)  rows  of  v  can  vanish-  l  «  ,  f  , 

-  an,  l.e.,  it  is  not  possible  that 

V1  '  — *  “Sale  solution  aii 

- - ^  ^Taabxes  associated  with  the 

v«tor.  in  the  tjju  _ ... - 

- - - -  v'  Sii  j  ail 

”  ~  ~  — '  *“  °°ndUlon  ln  <*>  —  "CM  h.  strengthened 
to  strict  Inequality 


0 


“  1»  ’  •  * ,  m)  . 


Let  t31  denote  the  1th  row  of  B  inverse 


^°'  V  ^2#  '*  PJm^  '  ^0>  $!>  fi'] 


where  primed  letters  stand  for  transpose 
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Theorem  I :  A  neoeaaary  and  aufficient  condition  that  a 
aolutlon  be  a  maximizing;  aolutlon  la 

(7)  ^0PJ  £  0  (J  -  1,  •••,  n)  . 

Theorem  II :  If  a  baalc  aolutlon  la  optimal,  then  any  other 
solution  (baalc  or  not)  with  the  property  that  Xj  -  0  whenever 
( Vj )  ^  0  alao  optimal  j  an^  aolutlon  with  x j  >  0  for  aome 

<Vj>  ^  0  not  optimal. 

Proof  as  Let  X  repreaent  an^  aolutlon  to  (l)  and  V  a  baalc 
aolutlon  with  baala  B;  then  multiplying  both  (l)  and  (4)  through  by 
(30  and  equating,  one  obtaina,  after  noting  from  (6)  that  (3  P  -  i 

*nd  Vjl  -0-  00 

( a  v  —  n  .  _ 

*0  *  jf  ^0Fj)xj  "  v0  ; 

whence,  aaauming  ^  >  o,  then  xQ  <  vQ  (which  eatabliahea  the 

auf flciency  of  Theorem  1);  moreover  the  condition  x j  -  0  whenever 
0OPJ  '  0  ( J  /  0),  impllea  the  aummatlon  term  of  (8)  vaniahea  and 
X0  "  v0;  Pereas  denial  of  thla  condition  impllea  the  aummation 
term  la  poaltlve  (eatabliahing  Theorem  II  if  Theorem  I  la  true). 

In  order  to  eatabllah  the  neceaaity  of  (7)  for  Theorem  1, 
let  Yg  be  a  column  vector  which  expreaaea  a  vector  Pg  as  a  linear 
combination  of  the  vectora  In  the  baais : 


(9)  P.  -  b(b-\)  .  by  - 

8  1-0  V  ia 

"here  U  18  evldent  (6)  th.t,  by  d.flnltll 


(Po  -  V 
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(10) 


'l8'  ^  U-o.  i.  ...,n)  . 

TTZ  which  **.  b0  fron 


U)  end  (9)  0f  the  fgfm 

<W  BOr  -  ,5]  +  P  e  >  m 


or  more  explicitly 


(12) 


poC5o  -  y0.®J  ♦  -  ylBej 


U  18  Cl*,lr  th<“  “‘"oo  7.  >  o  for  1  >  !  h„  h 

°8rUer'  <5>'  •  of ^solutions  with  0  ,  0T 

i££i£bil  BSSiSivs)  aiw.y,  .....  ..  “Uh  5 

dated  with  po  and ,  ln  in8t  0,8  vnriabi»»  •••*- 

«»  a  solution  to  y  <0  ”  n°'W’015"tlve"  admiaalble 

_  _  If’'0.<0.the„th.v.1u..0ftheM.olutloni8rB 


(13) 


V0  ~  y0sG  >  vr 


(y0a  <  o,  e  >  o)  . 


P°r  ‘  8lT'’n  inore—  l"  5  th.  greatest  Increase  in  u.  , 
th0  -lotion  (1 ...  direct! . .  .  ' 

choosing  a  .  3uch~  £L^ocont)  is  obtained  by 

(H)  BnP  m  M4n  I  a  n  t 


PoPe  "  "1»  (poPj)  <-  0 


rT‘  ;°tabll0he8  ^  111  <>— )  Which  is  clearly  only  a 

restatement  of  the  heceselty  df  condition  (T)  of  Iheorem  ' 


) 
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rrheorem  III :  There  exlata  a  claaa  of  aolutlona  with  values 
x0  ✓  vQt  If  for  aome  J  -  a 

(!5)  y0,  -  30P0  <  0 

Theorem  IV:  There  exists  a  class  of  aolutlona  with  no  upper 
bound  f9r  values  x^  j^f  for  aome  a  ,  yQa  <  0  and  yia  ^  0  for  aj.1  1  . 

Theorem  V :  There  exlata  a  new  baalc  solution  with  value 
*0  >  vO  '  (obtained  by  Introducing  Pg  Into  the  basis  and  dropping 
*  P *  ) >  If  for  some  s  ,  y_  <  0  and  for  aome  1 ,  y,  >  0  . 

From  (12)  if  y^B  ^  0  for  all  1,  then  ©  can  be  arbitrarily 
large  (l.e.,  lta  first  component  can  tend  to  +  oo '  and  the  coeffi¬ 
cients  of  will  remain  non-nogati ve .  The  vaiue  of  these  solu¬ 
tions  (13)  will  also  be  arbitrarily  large  providing  y^  <  0 

(establishing  Theorem  IV).  In  the  event  that  some  y,  >  0, 

1  s 

the  maximum  value  of  0  becomes 

(16)  Max  5  -  (l/yr3)vp  -  Min  (1/y,^  0  ,  (y  >0.1^0) 

ylo  >  0 

where  the  minimum  of  the  vectors  (taken  in  the  lexicographic  sense) 
occurs  for  a  unique  1  -  r  (since  the  rank  of  V  Is  m+1  ,  no  two  rows 
of  V  can  be  proportional,  whereas  the  assumption  of  non-uni quaneaa 
in  (16)  would  imply  two  rowB  of  V  to  be  oo  —  a  contradiction), 
betting  &  -  Max  0  in  (12)  yields  a  new  basic  solution  since  the 
coefficient  of  P^  vanishes.  Thus  a  new  basis  has  been  formed 
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conaiating • of  Tp  p 

V  V  f,J  "hare  p  la 

and  Ffl  io  put  ln  lnatea<j  ( Theorem  V).  r 

aimpi«  8oner*ii"d 

on  .11  varl.bl.a  (.  .  i  ,  .  J  i  0  not  lmpoaed 

fiction  no  *  n)‘  le*0»  to  a  alight  Bodl_ 

of  procedure:  flr,t.  for  .11  j  for  *lch  - 

required,  both  P  and  -  p  ahoulrt  v,  J  £  not 

oeoond,  If  P  J  ln  th  '  ^  C°n*ldered  “  «*“»•  of  P; 

Jl  *  ln  the  b*ols  °od  th.  restriction  v,  >  o  1.  not 
required,  then  thl.  term  c.nnot  lopes.  .  boun(1  on  s.  "* 

corT*-~ 1  -*«-  - — -  (»>  *. 


Starting  with  any  baalo  B  - 

baala  B(k+1)  bv  flrn.  .  .  '  °ne  can  determine  a  new 

y  irat  determining  the  vector  p  to  lnfl  . 

wie  uoaia  by  (11)  rr  ..  °  - -^nco 

y  '  If  th«re  exlata  no  a  p  <  n 

the  Rr.iitK  n_  i  / .  v  0  a  <*  then  hy  Tbrnrom  r 

- -  ia  optimal  and  b'k'  « *  ^  w“  L* 

then  one  forma  y  m  (fJ  F  i  — ~  If  a  Pa  °xlats, 

from  the  basl.  by0,^/1  3  ’  '‘t'*™lnoa  the  vector  P  to  drop 

by  (ip)  providing  there  are  y  >  n  T,r, 

exlat  no  y  ,  r>  *u  y*o  >  °‘  f  therG 

u  yia  then,  by  Theorem  iv  . 

obtained  from  (12)  with  *  °f  aolutl°na  la 

(^^n.Wrbcu„d(orV(r 

formed  d  ^  b<>  «-  ‘  »«  b..l.  B<W)  u 

formed  dropping  P  ,nd  replacing  u  by  p  . 

0.  of  this  solution  is  Strictly  greater  f  *  B<^)  tha„  ,  M 

olnce  0  >  0  la  chosen  by  (16)  ^  f°r  B‘  ’ 

starting  with  the  '  °"e  My  lto™tlvoly 

K  witn  the  aaaumed  lnltiAi  h».(  .. 

until  <hP  b  10  °nd  forminS  k  -  o,  l  2 

until  .he  proceaa  atopa  because  /„\  '  '  ‘ 

because  (a)  an  optimal  solution  has  been 
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obtained  or  (b)  bao.ua.  .  ol...  of  .elution,  with  no  finite  upper 
bound  has  been  obtained. 

The  number  of  different  base,  1.  not  exce,dlng  ^ 

number  of  combination,  of  n  thin*  taken  .  ,t  .  tlBe;  M<0#ut- 
with  each  baal.  B  1.  .  unique  bMla  .olutlon  „  .  _  henoe  ^ 

number  of  dlotlnct  ba.lo  .elution.  1.  finite; , finally,  no  ba.i. 
can  be  repeated  by  the  Iterative  procedure  bec.u.e  contrarlwl.e 
thl.  would  imply  a  repetition  of  the  value  v0  where.,  by  (l}) 

~  ^  101^  ^  2£2£S£2i2^ 

— r*“ins  ~  iSSHSJS.  ifi«  number  of  Iteration.  la  nnlte. 

lhe  k  +  lSt  u«”te  1.  closely  related  to  the  kth  by 

simple  transformations  that  comtlt»t« 

constitute  the  computational  algorithm  [6],  T?' 

»..ed  on  the  method:  thue  for  1  .  o.  1.  ,  (l  /  p) 


117.0' 


v.-k+l  -k  .  ^  -U 

'1  “  V1  +  Vi  vr 


— k+i  „ 

Vr  -  ?rvr 


rk 


(17.1  )  ^+1  „  p*  + 


^r"1  - 


wWe  the  suH^cri^  k  ♦  1  and  k  are  introduced  here  to  distinguish 
-  su  coasive  solutions  and  ba.es,  and  where  \  are  con.tant. 

%  "  ”yiB/yra  -  “*(PiP8^/(^rP0),  (ifr) 

Vr  "  *  1/(^rPs) 

Relation  (17.0)  is  a  consequence 
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°f  (12)  and  (16);  it  is  easy  to  verify  that  the  matrix  whose  rows 
are  defined  by  (111)  satisfies  the  proper  orthogonality  properties 
for  the  inverse  when  multiplied  on  the  right  by  the  k  +  lat  basis 

CV  PJ  *  ' '  ‘ '  PB'  “*<  P«D»  A®  8  consequence  of  the  iterative 
1  Jm 

procedure  we  have  established  two  theorems. 

Theorem  VI :  If  solutl one  exist  and  their  values  have  a 

HEJP,er  bound,  then  a  maximizing  solution  exists  which  is  a 
basic  solution  with  the  properties 


(19) 

B  V  -  Z  P .  v .  -  M 

1-0  Ji:  1 

( p j  ■  Po»  V1  >  0,  i  ■  1 ,  •••,») 

^opo  "  *3opj1  "  °»  Vj  ^  0 

(J-1|2,  n) 

vQ  -  P0M  -  Max  xQ 

J 

where 

Pq  —  the  lSt  ro*  of  B-1. 

Theorem  VII:  if  solutions 

no  finite  upper  bound,  then  a  basis  B 

the  properties 

exist  and  their  values  have 

and  a  vector  exist  with 

(20) 

m 

BV  -  >;  P.  v.  -  M 

1-0  Jl  1 

(P j  ■  VV  o,  1-1,  •,  m) 

B0P0  <  0,  01P8  <  0 

>:  -  (^P„)eJ  *  ps5 

-  M 
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gj.th  ®  >  0  arbitrary,  form  a  data  of  solution* 
unbounded  valuta  (pA  la  tht  1  +  l8t  row  of  B"1). 

Cloatly  rtlattd  to  the  methods  of  the  next  section,  a 
constructive  proof  will  now  be  given  to 


Theorem  VIII:  If  any;  solution  exists,  then  a  basic 
solution  exists . 

For  this  purpose,  adjust  M  so  that  the  first  non-aero 
component  of  eaoh  row  is  positive  and  consider  the  augmented 

system 


(20.1) 


n 

z 

i-o 


__  i 


A 


in. 


xn+i  + 


n-hn+1 


fh  • 

i 


(xj>°»  J  “•!,  ....  n-Hn) 


_  i 


where  Xj  has  one  more  component  than  x,  and  •  represents  the 
null  vector.  Noting  neither^  nor  \+m+l  18  required  to  be  poai- 
•ive,  an  obvious  basio  solution  is  obtained  using  the  variables 

rwi  — '  _  i  .. 

1*0'  xn+l '  xn-tre+lJ  *  :t  w111  b*  noted  that  the  hypothetic  of 

the  theorem  permits  construction  of  a  solution  for  whioh  x’  -  0 
/  i  n+1 

(1"1,2 . m*-  for  J  <  n  lit  .  (ij,  o)  >  0.  However, 

It  win  be  noted  alec  that  Z  *ntl  *  C  •  1  3  «o  that  Max  xn+J  -  [,  j]  . 

Accordingly,  one  nay  et*rt  with  the  baelo  eolutlon  for  the  augmented 

ayetem,  keeping  the  vectors  correepondlng  to  xl  and  x*  alwave 

w  n+m+l  * 

in  the  basis  use  the  simplex  algorithm  to  Max  x*  ..  Sinco  at 
f  n+m+1 

the  maximum  xn+1  -  0.  (]  j  m+1 ) .  the  corresponding  vectors  are  not 
4n  the  basis  any  longer,  see  (5).  By  dropping  the  last  component  of 
this  i.anlc  solution  and  by  dropping  xr'1+mfl  .  one  Is  left  with  a 
basic  solution  to  the  original  system.  (Q.E.D.). 
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SECTION  II 

MINIMIZING  A  LINEAR  FORM 

The  application  of  the  generalized  simplex  method  to  tho  problem 
of  minimizing  a  linear  form  subject  to  linear  inequality  restralnto 
consists  in  bordering  the  matrix  of  coefficients  and  constant  terms 
of  the  given  system  by  appropriate  vectors.  This  can  be  done  in 
many  ways  —  tho  one  selected  is  one  which  identifies  the  Inverse 
of  the  basis  as  the  additional  components  in  a  generalized  matrix 
problem  so  that  computationally  no  additional  labor  is  required 
when  the  inverse  is  known. 

The  fundamental  problem  which  we  wish  now  to  solve  is  to 
find  a  set  x  ■  x^,  •  ••,  xn)  of  real  numbers  satisfying  the 

equations 


(22)  xj  d  0 

( 23 )  x0  "  Max 

where  without  loss  of  generality  one  may  assume  b^  ^  0.  It  will  be 
noted  that  the  subscript  k  -  1  has  boen  omitted  from  (21).  After 
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# 

aome  experimentation  It  has  been  found  convenient  to  augment  the 
equations  of  (21)  by  a  redundant  equation  formed  by  taking  the 
negative  sum  of  equations  k  -  2,  m.  Itiua 


<2M  £  OjjXj  .  bl 


m 

-la 

k-2 


kj' 


m 

X  bk)  . 
2  K 


Consider  the  generalized  problem  of  finding  a  set  of  vector 
"variables"  (in  the  sense  of  Section  I)  (xQ,  x1#  xn)  and 

auxiliary  variables  (xn+1,  xn+2,  •••,  xn+m)  satisfying  tho  matrix 
equations 

(25)  X0  +  £  a0JXj  .  (0,  1.0.  •••,0) 

*n+k  +  f  “k/j  ’  (bk'0'0*,-'>1<’”>0)  <bi<  °:  bk>0,  k-2,  •••,■") 

where  the  constant  vectors  have  »  m  +  2  components  with  unity  In 
position  k  +  2,  Xq  and  xn+1  are  unrestricted  as  to  sign  and,  for 
all  other  J, 


(2b)  x  j  0  (  J  ■  1  #  *  *  *  *  'n  f  n  +  2,  •  •  •,  n  +  m). 

Adding  equations  k  -  1,  •••,  m  In  (2b)  and  noting  the  definitions 
of  a^  ^  and  b^  given  in  (24) 

Baaed  on  a  recent  suggestion  of  W.  Orchard— Hays . 
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(27) 


m 

f  xn+k  '  <°-  0.  1.  . . .  1)  . 


Hiere  la  a  clcae  relatlonahlp  between  the  solutlono  of  (25) 
and  those  of  (21 )  when  xn+1  >  0.  for  then  the  first  components  of 
Xj  for  J  -  0,  n  satisfy  (21).  indeed  by  (27),  If  ,11  ^  >  0> 

the  first  component  of  all  «n+k  must  v.nlah.but  the  lat  component 
of  the  vector  equations  (25)  reduces  to  (21)  when  the  terns  Involving 
rn+k  are  Chopped.  This  proves  the  sufficiency  of  Theorem  IX  (below). 

Theorem  IX:  A  necessary  and  sufficient  condition  for  a 
— Lutl0n-  (21)  to  exist  la.  a  solution  to  (25)  to  exist  with 


THaorem  X:  Maximizing  solutions  (or  a  class  of  solutions 
with ^unbounded  values)  to  (21)  are  obtained  from  the  l8t  component. 
—  (x0-  *n)  S£  the  corresponding  type  solution  to  (25)  with 

xn+l  0.  °- 

To  prove  necessity  In  IX,  assume  (xQ,  ....  xn)  satisfies 

(21);  then 


X0  - 

(x0' 

1, 

0, 

•  •  •  #  0) 

- 

(xj. 

0, 

0, 

•  ■  • »  0) 

1  <  J 

<  n 

xn4k  " 

(0, 

0, 

1, 

•  •  *,  0)  >0 

1  <  k 

S  m 

(where  unity  occurs  In  position  k  *  2) satisfies  (25).  Because  of  the 
possibility  of  forming  solutions  of  the  type  (SB)  from  solutions  to 
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(21),  it  is  e»sy  to  show  that  1st  components  of  maximizing  solutions 
to  (25)  must  be  maximizing  solutions  to  (26)  (nieorem  X). 

It  will  be  noted  that  (25)  satisfies  the  requirements  for 
the  generalized  simplex  process:  first  the  right-hand  aide  con¬ 
sidered  as  a  matrix  is  of  form  M  -  R,  UQ,  u1#  ••.,  uj  where  Uk 
is  a  unit  column  vector  with  unity  in  component  k  +  l  and  is  of 
rank  m  4-  1  (the  number  of  equations);  second,  an,  initial  basic 

solution  is  available.  Indeed  set  x,„  x  ,  ,  x  •••  x 

0*  *n4l»  n+2#  *  xn+m  e<lual 

to  the  corresponding  constant  vectors  in  (25)  where  xn+k  >  o  for 
k  ■  2,  •••,  m  because  bk  >  0. 

In  applying  the  generalized  simplex  procedure,  however, 

^oth  xQ  and  xn+1  are  not  restricted  to  be  non-negative.  Since 

Xn+k  -  0  for  (k  "2>  •••,  m),  it  follows  that  the  values  of  the 
solutions,  xn+1,  to  (27)  have  the  right-hand  side  of  (27)  on  nn 
upper  bound. 

To  obtain  a  maximizing  solution  to  (25),  the  first  phase 
is  to  apply  the  generalized  simplex  procedure  to  maximize  the 
var-labl,  Sn4l  (with  no  re.trlcticn  on  x0 ) .  Since  1^,'haa  a  flnlt. 

upper  hound,  .  bnaic  solution  will  I  r  "reduced  ,fi, r  a  finite  number 
°‘  ^  1"  which  7,,,,  >  t,  providing  >’.*  *  >  C.  If 

during  the  first  phene  re., ches  .  maximum  lean  than  ,ero,  then, 

of  course,  by  Theorem  H  there  it  no  solution  to  (21)  end  the  proceafc 
terminates.  If,  1„  the  iterative  proc.ee,  *n„  b.comen  positive  (even 
though  not  maximum),  the  first  johuce,  which  is  the  search  for  a  solution 
to  (21),  is  completed  and  the  second  phase,  which  is  the  search  for 


) 
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an  optimal  solution,  begins.  Using  the  final  basis  of  the  first 

Phase  In  the  second  phase,  :?0  is  maximized  under  the  additional 
restraint  x  >  o. 

Since  the  basic  set  of  variables  f,re  taken  in  the  Initial 
order  (xQ,  xn+1,  xn+m)  and  in  the  first  phase  the  variable 

Xn+1  ia  maxl'nlzed,  the  second  row  of  the  Inverse  of  the  basis. 

18  US®d  t0  "aelect"  the  candidate  Pa  to  introduce  into  the 
basis  in  order  to  increase  *n+1,  see  (14);  hence  a  la  determined 
such  that 


(29) 


V. 


M1"  (PiPJ  <  0 
J  J 


However,  in  the  second  £hase,  nlnr.e  the  variable  to  be  maximized 
is  xQ  and  the  order  of  the  basic  set  of  variables  is  (x„,  x  ...\ 
then  the  first  row  of  the  Inverse  of  the  basis.  p0,  is  used;  l.e., 
one  reverts  back  to  (14).  Application  of  the  generalized  simplex 
procedure  In  the  second  phase  yields,  after  a  finite  number  of 
changes  in  basis,  either  a  solution  with  Max  x0  or  a  class  of 
solutions  of  fora  (12)  with  no  upper  bound  for  xQ.  By  Theorem  X 
the  first  components  of  3^,  ...,  ^  f0rm  the  corresponding 
solutions  to  the  real  variable  problem. 

The  computational  convenience  of  this  setup  Is  apparent. 

In  the  first  place  (ns  noted  earlier),  the  right-hand  side  of  (21) 
considered  as  a  matrix  1.  of  form  M  -  CQ.  U„,  U> ,  •  •  • ,  uj  where  ^ 
is  a  unit  column  vector  with  unity  In  component  k  ♦  1.  m  this  case, 
by  (4),  the  basic  solution  V  ~  lT1  M  «  [b_1q;  B_1‘J 


This  means 
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(in  thla  nose)  that  of  the  m  +  3  components  of  the  vector  v1 

the  lost  m  +  1  components  of  the  vector  variables  ^  In  the  baalo 
solution  are  Identical^  with  the  corresponding  row  of  the 
Inverse.  In  applications  this  fact  Is  Important  because  the 
last  m  +  1  components  of  v1  are  artificial  In  the  sense  that 
they  belong  to  the  perturbation  and  not  to  the  original  problem 
and  It  la  desirable  to  obtain  them  with  as  little  effort  as 
possible,  in  the  event  that  M  has  the  special  form  above,  no 
additional  computational  effort  la  required  when  the  Inverse  of 
the  basis  Is  known.  Moreover,  the  columns  of  (25)  corresponding 
to  the  (m+1 )  variables  (xQt  xffl+1,  •••,  xn+fn)  form  the  Initial 
identity  basis  (UQ,  U1#  •••,  Uj,  so  that  the  Inverse  of  the 
Initial  basis  la  readily  available  as  the  identity  matrix  to 
initiate  the  first  Iteration. 
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